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The effects of drift on calibrations 
carried out by comparison have been 
studied at the National Institute of 
Standards and Technology for many 
years, and a number of strategies have 
been introduced to combat these effects. 
One strategy, the use of comparison 
designs which are inherently immune to 
linear drift, was developed specifically 
for mass comparison measurements. 
These techniques, developed for simul- 
taneous comparisons, are extended to 
the case of non-simultaneous compari- 



sons, such as gage block calibrations, 
where each artifact is measured sepa- 
rately, and the comparison is made 
mathematically from the individual mea- 
surements. 
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1. Introduction 

The sources of variation in measurements are 
numerous. Some of the sources are truly random 
noise, 1// noise in electronic circuits for example. 
Usually the "noise" of a measurement is actually 
due to uncontrolled systematic effects such as 
instability of the mechanical setup or variations in 
the conditions or procedures of the test. Many of 
these variations are random in the sense that they 
are describable by a normal distribution. Like true 
noise in the measurement system, the effects can 
be reduced by making additional measurements. 

Another source of serious problems, which is not 
random in nature is drift in the instrument read- 
ings. This effect cannot be minimized by additional 
measurement because it is not generally pseudo- 
random, but a nearly monotonia shift in the read- 
ings. In dimensional work the most important 
cause of drift is thermal changes in the equipment 
during the test. In this paper we will demonstrate 



techniques to address this problem of instrumental 
drift. 

A simple example of the techniques for eliminat- 
ing the effects of drift by looking at two different 
ways of comparing two gage blocks, one standard 
(A) and one unknown (B). 

Scheme 1: A B A B 

Scheme 2: A B B A 

Now let us suppose we make the measurements 
regularly spaced in time, 1 time unit apart, and 
there is an instrumental drift of A. The actual read- 
ings {mi) from scheme 1 are: 



mi - A 


(la) 


mt= B + A 


(lb) 


mi=A +2A 


(Ic) 


mi = B+3A 


(Id) 
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Solving for B in terms of A we get: 



1 



B = A —■z(mi+m3—m2—m4) —A (2) 



which depends on the drift rate A. 

Now look at scheme 2. Under the identical 
conditions the readings are: 



mi = A 


(3a) 


mi =B + A 


(3b) 


mz =B+2A 


(3c) 


mA =A +3 A 


(3d) 



Here we see that if we add the second and third 
readings and subtract the first and fourth readings 
we find that the A drops out: 



B = A--x{m\+mA-mi-mi) (4) 



Thus if the drift rate is constant— a fair approxima- 
tion for most measurements if the time is properly 
restricted— the analysis both eliminates the drift 
and supplies a numerical approximation of the drift 
rate. 

The calibration of a small number of "unknown" 
objects relative to one or two reference standards 
involves determining differences among the group 
of objects. Instrumental drift, due most often to 
temperature effects, can bias both the values as- 
signed to the objects and the estimate of the effect 
of random errors. This paper presents schedules 
for sequential measurements of differences that 
eliminate the bias from drift and at the same time 
gives estimates of the magnitude of drift. 

Previous works have [1,2] discussed schemes 
which eliminate the effects of drift for simul- 
taneous comparisons of objects. For these types of 
measurements the difference between two objects 
is determined at one instant of time. Examples of 
these types of measurements are comparisons of 
masses with a double pan balance, comparison of 
standard voltage cells, and thermometers which are 
all placed in the same thermalizing environment. 
Many comparisons, especially those in dimensional 
metrology, cannot be done simultaneously. For 
example, using a gage block comparator, the stan- 
dard, control (check standard) and test blocks are 
moved one at a time under the measurement 
stylus. For these comparisons each measurement is 
made at a different time. Schemes which assume 
simultaneous measurements will, in fact, eliminate 



the drift from the analysis of the test objects but 
will produce a measurement variance which is drift 
dependent and an erroneous value for the drift, A. 

Calibration designs involve differences between 
measured items so that unless one or more of them 
are standards for which values are known, one 
cannot assign values for the remaining "unknown" 
items. Algebraically, one has a system of equations 
that is not of full rank and needs the value for one 
item or the sum of several items as the restraint to 
lead to a unique solution. The least squares 
method used in solving these equations has been 
presented [3] and refined [4] in the literature and 
will not be repeated in detail here. The analyses of 
particular measurement designs presented later in 
this paper conform to the method and notation 
presented in detail by Hughes [3]. 

The schemes used as examples in this paper are 
those currently used at NIST for gage block 
comparisons. In our calibrations a control (check 
standard) is always used to generate data for our 
measurement assurance plan [5]. It is not neces- 
sary, however, to use a control in every design and 
the schemes can be used with any of the objects as 
the standard and the rest as unknowns. Schemes of 
various numbers of unknowns and measurements 
are presented in the Appendix. 

2. Calibration Designs 

The term calibration design has been applied to 
experiments where only differences between 
nominally equal objects or groups of objects can be 
measured. Perhaps the simplest such experiment 
consists in measuring the differences between the 
two objects of the n{n—\) distinct pairings that 
can be formed from n objects. If the order is unim- 
portant, X compared to Y is the negative of Y com- 
pared to X, and there are only n{n— 1)/2 distinct 
pairings. Of course only one measurement per 
unknown is needed to determine the unknown, but 
many more measurements are generally taken for 
statistical reasons. Ordinarily the order in which 
these measurements are made is of no conse- 
quence. However, when the response of the 
comparator is time dependent, attention to the 
order is important if one wishes to minimize the 
effect of time. 

When this effect can be adequately represented 
by a linear drift, it is possible to balance out the 
effect by proper ordering of the observations. The 
drift can be represented by the series, ... -3, -2, 
-1, 0, 1, 2, 3, . . . if there are an odd number of 
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comparisons and by . . . — 5/2, — 3/2, — 1/2, 1/2, 3/2, 
5/2, ... if there are an even number of 
comparisons. 

As an example let us take n =3. If we make 12 
measurements to obtain all possible «(«—!) = 6 
comparisons we get a scheme like that below, 
denoting the three objects by A, B, C. 



Observation 


Measurement 


mi 


A 


- 


6A 


OT2 


B 


- 


5A 


/W3 


C 


- 


4A 


mn 


A 


- 


3A 


nts 


B 


- 


2A 


ma 


C 


- 


A 


mi 


A 


+ 


A 


m» 


C 


+ 


2A 


/n<) 


B 


+ 


ZA 


OTlO 


A 


+ 


4A 


OTu 


C 


+ 


5A 


m\2 


B 


+ 


6A 



(5) 



If we analyze these measurements by pairs, in anal- 
ogy to the weighing designs of Cameron we see 
that: 



(6) 







A 


B 


C 


A 


di = mi — m2 


=A-B-A 


+ 1 


-1 




-1 


di = m3-m4 


= C-A-A 


-1 




+ 1 


-1 


ds = ms-ma 


= B-C-A 




+ 1 


-1 


-1 


dA = mi — ms 


=A-C-A 


+ 1 




-1 


-1 


ds = m<)-mio 


= B-A-A 


-1 


+ 1 




-1 


df, = mu-mn 


= C-B-A 




-1 


+ 1 


-1 



the calibration. In the NIST gage block laboratory 
the environment is stable enough that the drift is 
linear at the 5 nm level over periods of 5 to 10 min. 
Our comparison plans are chosen so that the 
measurements can be made in this period. 

Secondly, each measurement must be made in 
about the same amount of time so that the 
measurements are made at fairly regular intervals. 
In a completely automated system this is simple, 
but with human operators there is a natural 
tendency to make measurements simpler and 
quicker if the opportunity presents itself. For 
example, if the scheme has a single block measured 
two or more times in succession it is tempting to 
measure the object without removing it from the 
apparatus, placing it in its normal resting position, 
and returning it to the apparatus for the next 
measurement. 

Finally, the measurements of each block are 
spread as evenly as possible across the design. 
Suppose in the scheme above where each block is 
measured four times block A is measured as the 
first measurement of d\, dj, di, and d^. There is a 
tendency to leave block A near the measuring 
point rather than its normal resting position be- 
cause it is used so often in the first part of the 
scheme. This allows block A to have a different 
thermal handling than the other blocks which can 
result in a thermal drift which is not the same as 
the other blocks. 



The notation used here, the plus and minus signs, 
indicate the items entering into the difference 
measurement. Thus, d^ is a measurement of the 
difference between object C and object A. 

The difference between the above design and 
that of a design for simultaneous comparisons in 
Ref. [2] is that the drift column is constant. It is 
simple to see by inspection that the drift is 
balanced out since each object has two ( + ) and 
two ( — ) measurements and the drift column is 
constant. By extension, the effects of linear drift is 
eliminated in all complete block measurement 
schemes (those for which all objects are measured 
in all possible « (n - 1) combinations). 

Although all schemes in which each object has 
equal numbers of ( + ) and ( — ) measurements is 
drift eliminating, there are practical criteria which 
must be met for the scheme to work. First, the 
actual drift must be linear. For dimensional 
measurements the instrument drift is usually due to 
changes in temperature. The usefulness of drift 
eliminating designs depends on the stability of the 
thermal environment and the accuracy required in 



3. Restraints 

Because all of the measurements made in a 
calibration are relative comparisons, at least one 
value must be known to solve the system of equa- 
tions. In the design of the last section, for example, 
if one has a single standard and two unknowns, the 
standard can be assigned to any one of the letters. 
(The same would be true of two standards and one 
unknown.) If there are two standards and one 
unknown, the choice of which pair of letters to 
assign for the standards can be important if all of 
the possible comparisons are not made. For full 
block designs (all possible comparisons are made) 
the uncertainty of the result does not depend on 
which letter is assigned to the standards or 
unknowns. For incomplete block designs the uncer- 
tainty of the results can depend on which letter the 
standard and unknowns are assigned. In these 
cases the customer blocks are assigned to minimize 
their variance and allow the larger variance for the 
measurement of the extra master (control). 
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This asymmetry occurs because every possible 
comparison between the four items has not been 
measured. For 4 objects there are 12 possible inter- 
comparisons. If an eight measurement scheme is 
used all three unknowns cannot be compared 
directly to the standard the same number of times. 
For example, two unknowns can be compared 
directly with the standard twice, but the other 
unknown will have no direct comparisons. This 
indirect comparison to the standard results in a 
slightly larger variance for the block compared 
indirectly. Complete block plans, which compare 
each block to every other block equal number of 
times, has no such asymmetry, and thus removes 
any restriction on the measurement position of the 
control. 



4. Example: 4 block, 12 comparison, 
Single Restraint Design for NIST 
Gage Block Calibration [4] 

The gage block comparison scheme put into 
operation in 1989 consists of two standards blocks, 
denoted S and C, and two customer blocks to be 
calibrated, denoted Y and Z. In order to decrease 
the random error of the comparison process a new 
scheme was devised, consisting of all 12 possible 
comparisons between the four blocks. Because of 
continuing problems making penetration correc- 
tions, the scheme was designed to use either the S 
or C block as the restraint and the difference 
(5 -C) as the control parameter. The S blocks are 
all steel, and are used as the restraint for all steel 
customer blocks. The C blocks are chrome carbide, 
and are used as the restraint for chrome and tung- 
sten carbide blocks. The difference (5 - C) is inde- 
pendent of the choice of restraint. 

We chose a complete block scheme which 
assures that the design is drift eliminating and the 
blocks can be assigned to the letters of the design 
arbitrarily. We chose (5 — C) as the first compari- 
son. Since there are a large number of ways to ar- 
range the 12 measurements for a complete block 
design, we added two restrictions as a guide to 
choose a "best" design. 

1. It was decided to avoid schemes which 
measured the same block two or more times 
consecutively. There are many possible schemes 
where one or more blocks are measured twice 
consecutively. There is a great temptation to not 
remove and replace the blocks under these condi- 
tions. The analysis assumes that each measurement 
is made with the same motion and that the 



measurements are evenly spaced in time. Consecu- 
tive repetition threatens both these assumptions. 

2. We decided that schemes in which the six 
measurements of each block were spread out as 
evenly as possible in time would be less likely to be 
affected by small non-linearities in the drift. For 
example, for some schemes measurements of one 
block are completed by the 8th comparison, leaving 
the final 1/3 of the comparisons with no sampling of 
that block. 

The new scheme is as follows: 



d, = S-C 


1 


-1 








-1 


d2 = Z-S 


-1 








1 


-1 


d3 = Y-Z 








1 


-1 


-1 


d4 = C-S 


-1 


1 








-1 


ds = C-Y 





1 


-1 





-1 


D =d6 = Z-C 


^ = 


-1 





1 




di = S-Y 


1 





-1 





-1 


d» = C--Z 





1 





-1 


-1 


d^ = S-Z 


1 








-1 


-1 


d,„=Y-C 





-1 


1 





-1 


dn=Y-S 


-1 





1 





-1 


d,2=Z-Y 








-1 


1 


-1 



(7) 



When the S block is the restraint, with value L , the 
matrix equation to solve is: 



(8) 



where [/I '] = [S C Y Z A] is the vector to be 
estimated and [a'] = [1 0] is the restraint 
vector. 



X'X a 
a' 


A 
A 


= 


X'Y 
L 



X'X a 
a' 



6 


-2 


-2 


-2 





1 


2 


6 


-2 


-2 








2 


-2 


6 


-2 








2 


-2 


-2 


6 




















12 





1 


















(9) 









-1 


B h 




X'X a 






= 




= (1/24) 


h' 




a' 




















24 





6 


3 


3 





24 





3 


6 


3 





24 





3 


3 


6 





24 














2 





24 


24 


24 


24 









(10) 



220 



Volume 98, Number 2, March-April 1993 

Journal of Research of the National Institute of Standards and Technology 
The estimate for A can be written as 



<A> = 



^X' h\ 



= 1/24 




































24 


-6 


3 





6 


3 


-3 


-3 


3 


-3 


-3 


3 


-3 24 


-3 


3 


3 


3 


3 





-6 





-3 


3 


6 


-3 24 


-3 


6 


-3 


3 





3 


-3 


-3 


-6 





3 


3 24 



-2 -2 -2 -2 -2 -2 -2 -2 -2 -2 -2 -2 



This leads to estimated values ior S, C,Y, Z, and 
A which can be written as a function of the com- 
parison measurements: 



<5> 
<C> 
<Y> 
<Z> 
<A> 



= L 



(1/8) { - 2di + di + 2d^ + ds - d(, - dn + di - d') - dm + dn) + L 
(1/8) ( - di + di + di + di - ds - 2dT - dg + diQ + 2dn - dn) + L 
(1/8) I - di + Idj - di + di + df, - dy - ds - 2d9 + dn + dn) + L 
(-V12)(di + di + di + di + ds + di + dy + ds + d9 + dw + dn + dn) + L 



(11) 



(12a) 
(12b) 
(12c) 
(12d) 
(12e) 



The deviations of the measured values from the 
estimated values, ei, ej, . . . , en can be determined 
from the equations above, or can be calculated 
directly using matrix methods. For example. 



ei = (ifl)obseived-(<5> - <C>) . 



(13) 



These deviations provide the information needed 
to obtain a value, Sw, which is the experimental es- 
timate value for the short term process standard 
deviation, or within standard deviation aw. 



" S 2 

,t; (n-m+l) 



(14) 



The number of degrees of freedom, («— m + 1), 
results from taking the number of observations 
(« = 12) less the number of unknowns {m =5; S, C, 
Y, Z, A), and then adding one for the restraint. 
Because of the complete block structure (all 12 
possible combinations measured) the standard 
deviations of the predicted values for the three 
unknowns are the same: 



Is. Process Control 
5.1 F-Test 

Continued monitoring of the measurement pro- 
cess is required to assure that predictions based on 
the accepted values for process parameters are still 
valid. For gage block calibration at NIST, the 
process is monitored for precision by comparison of 
the observed standard deviation, Sw , to the average 
of previous values, ou. . For this purpose the value of 
Sw is recorded for every calibration done, and this 
data set is periodically analyzed to provide an 
updated value of the accepted process ow for each 
gage block size. 

The comparison is made using the F distribution, 
which governs the comparison of variances. The 
ratio of the variances s ^ (derived from the model fit 
to each calibration) and al derived from the 
history is compared to the critical value F(8, oo, a), 
which is the upper a probability point of the F 
distribution for degrees of freedom 8 and oo . For 
calibrations at NIST, a is chosen as 0.01 to give 
F(8, 00, .01) = 2.5. The condition to be checked is: 



sc = sy = sz = (1/2) s 



(15) 



F =^<2.5. 



(17) 



The standard deviation of the predicted drift is 



55 = 




12 J 



(16) 



If this condition is violated the calibration fails, and 
is repeated. If the calibration fails more than once 
the test blocks are re-inspected and the instrument 
checked and recalibrated. All calibrations, pass or 
fail, are entered into the history file. 



221 



Volume 98, Number 2, March-April 1993 

Journal of Research of the National Institute of Standards and Technology 



5.2 /-Test 

At NIST a control measurement is made with 
each calibration by using two known master blocks 
in each calibration. One of the master blocks is 
steel and the other chrome carbide. When a 
customer block is steel the steel master is used as 
the restraint, and when a customer block is 
carbide, the carbide master is used as the restraint. 
The use of a control measurement for calibrations 
is necessary in order to provide assurance of the 
continuing accuracy of the measurements. The 
F-test, while providing some process control, only 
attempts to control the repeatibility of the process, 
not the accuracy. The use of a control is also the 
easiest method for finding the long term variability 
of the measurement process [5], 

While the use of a control in each calibration is 
not absolutely necessary, the practice is highly rec- 
ommended. There are systems which use intermit- 
tent tests, e.g., measures a control set once a week 
[4]. This is a good strategy for automated systems 
because the chances of block to block operator 
errors is reduced greatly. For manual measure- 
ments the process variability, and of course the 
occurence of operator error is much higher. 

The check for systematic error is given by com- 
parison of the observed value of the difference 
between the standard and control blocks. If S is the 
standard it becomes the restraint, and if A is used 
as the control (5 —A ) is the control parameter for 
the calibration. This observed control is recorded 
for every calibration, and is used to periodically 
update the accepted, or average value, of the 
control. The process control step involves the com- 
parison of the observed value of the control to the 
accepted (historical) value. The comparison is 
made using the Student /-distribution. 

The control test demands that the observed 
difference between the control and its accepted 
value be less than 3 times the accepted long term 
standard deviation, cr,, of the calibration process. 
This value of the t-distribution implies that a good 
calibration will not be rejected with a confidence 
level of 99.7%. The condition to be checked is: 



|(<5>-<C>-(5-C;„„| 
t =- <3 



cr, 



(18) 



The value of a, is obtained directly from the 
sequence of values of(<5>-<C>) arising in 
regular calibrations. The recorded {<S > - <C >) 
as the restraint, and <S > - <C> is again used 
as the control. 



If both the precision (/"-test) and accuracy 
(/-test) criteria are satisfied, the process is 
regarded as being "in control" and values for the 
unknowns, Y and Z, and their associated uncer- 
tainties are regarded as valid. Failure of either 
criterion is an "out-of-control" signal and the 
measurements are repeated. 

The value for drift, (A), serves as an indicator of 
possible trouble if it changes markedly from its 
usual range of values. However, because any linear 
drift is balanced out, a change in the value does not 
of itself invalidate the result. 

6. Conclusion 

The choice of the order of comparisons is an 
important facet of calibrations, in particular if 
chosen properly the comparison scheme can be 
made immune to linear drifts in the measurement 
equipment. The idea of making a measurement 
scheme robust is a powerful one. What is needed 
to implement the idea is an understanding of the 
sources of variability in the measurement system. 
While such a study is sometimes difficult and time 
consuming because of the lack of reference mate- 
rial concerning many fields of metrology, the NIST 
experience has been that such efforts are rewarded 
with measurement procedures which, for about the 
same amount of effort, produce higher accuracy. 

7. Appendix A. Selection of Other Drift 
Eliminating Designs 

The following designs can be used with or with- 
out a control block. The standard block is denoted 
S, and the unknown blocks yl ,B,C, etc. If a check 
standard block is used it can be assigned to any of 
the unknown block positions. The name of the 
design is simply the number of blocks in the design 
and the total number of comparisons. 



3-6 Design 


3 


- 9 Design 


(One master block, 


(One 


master block, 


2 unknowns 


2 unknovms 


4 measurements each) 


6 measurements each) 


yi = S-A 


y\. 


= 


S-A 


y2 = B-S 


3'2 


= 


B-A 


y3 = A-B 


3'3 


= 


S-B 


yA = A-S 


3'4 


= 


A-S 


ys = B-A 


ys 


= 


B-S 


yi = S-B 


3'6 


= 


A-B 




yi 


= 


A-S 




ys 


= 


B-A 




ys 


= 


S-B 
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4 - 8 Design 


4- 


12 


Design 


9- 


18 


Design 


10. 


■ 20 Design 


(One master block, 


(One master block, 


(One 


master block. 


(One 


master block. 


3 unknowns 


3 unknowns 


7 unknowns 


9 unknowns 


4 measurements each) 


6 measurements each) 


4 measurements each) 


4 measurements each) 


yi = 


5-^ 


yi 


= 


S-A 


yi 


= 


S-A 


yi 


^ 


S-A 


y2 = 


5-C 


y2 


= 


C-S 


y2 


= 


H-F 


y2 


= 


F-G 


yi = 


C-5 


y3 


= 


B-C 


y3 


= 


A-B 


y3 


= 


I -C 


y* = 


A-B 


y* 


= 


A-S 


y4 


= 


D-C 


y4 


= 


D-E 


ys = 


A-S 


ys 


= 


A-B 


ys 


= 


E-G 


ys 


= 


A-H 


yi = 


C-B 


ye 


= 


C-A 


ye 


= 


C-A 


ye 


= 


B-C 


yi = 


S-C 


yi 


= 


S-B 


yi 


= 


B-F 


y-> 


= 


G-H 


ys = 


B-A 


y« 


= 


A-C 


ys 


= 


G-H 


ys 


= 


I -S 






yi 


= 


S-C 


ys 


= 


D-S 


ys 


= 


E-F 






yio 


= 


B-A 


yio 


= 


C-E 


yio 


= 


H-I 






yn 


= 


B-S 


yii 


= 


H-S 


yii 


= 


D-F 






yn 


= 


C-B 


yi2 


= 


G-D 


yi2 


= 


A-B 












yi3 


= 


C-S 


yi3 


= 


C-I 












yi4 


= 


A-C 


yi4 


= 


H-E 


5-10 


Design 


6- 


12 


Design 


yi5 


= 


F-D 


yi5 


= 


B-G 


(One master block, 


(One 


master block. 


yi6 


= 


S -H 


yifi 


^ 


S -D 


4 unknowns 


5 unknowns 


yi7 


= 


E-B 


yi7 


^ 


F-B 


4 measurements each) 


4 measurements each) 


yis 


^ 


F-G 


yis 


^ 


C-D 


















yi9 
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G-S 


yi = 


S-A 


yi 
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S-A 








y2o 
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E-A 


y2 = 


D-C 


y2 
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D-C 














y-i = 
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yz 
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E-B 
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E-D 


(One 


master block, 
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ys = 


C-B 
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10 unknowns 
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A-C 


ys 
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B-C 


4 measurements each) 
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robust is a powerful one. What is needed to imple- 
ment the idea is an understanding of the sources of 
variability in the measurement system. While such 
a study is sometimes difficult and time consuming 
because of the lack of reference material concern- 
ing many fields of metrology, the NIST experience 
has been that such efforts are rewarded with mea- 
surement procedures which, for about the same 
amount of effort, produce higher accuracy. 
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